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abstract 

This project, located in a 
district, concerns the operation and evalua- 
Demonstration Centers. Tn the first phase, < 
the necessary information to be gathered by the evaluating 

organization, (e.g. the school district adm 

size of school district, description o^ pro 
project schools, the project organization.) 
chronoloaical listing of activities that take place during the actual 
evaluation process, including the selection of experimental^ and. 
comparison groups, selection of experimental teachers, compilation of 
information on pupils, preparation of progress reports, and design of 
the final review report. A summary of audiovisual materials related 
to this simulated exercise are appended. (IN) 
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Design review 
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Design review task 
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Design review report form 



FORM 1 



Initial Statement of the Over -all Task January 

Your organization, the CSEIP evaluation agency, has just 
signed a contract with a large metropolitan school district 
to conduct an evaluation of a demonstration mathematics 
program for the coming school year. The district has re- 
ceived special funds from the state to conduct this pro- 
gram during this next year. 



It is now January and you are faced with the task of plan 
ning for the evaluation which will commence with the 
school year in September. What over-all issues must be 
considered? Think about what you need to know about the 
total situation before you can begin to plan your evalua- 
tion? 

Your first scheduled meetings with officials from the 
school district will begin very shortly. Good, luck. 
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FORM 2 

Information distributed by the school district to describe the 
program. 

MATHEMATICS DEMONSTRATION CENTERS 
There will be three Mathematics Demonstration Centers designed 
to encourage creative, innovative, and unique approaches in 
curricula and methodology in the teaching of mathematics. Those 
techniques which achieve greatest success ultimately will be used 
as a basis for the development of programs which will improve 
substantially the educational achievement . of disadvantaged chil- 
dren of normal capabilities . who are now achieving at one grade 
level or more below average in mathematics. 

The particular strength of the program is that it brings to- 
gether under the coordination of a central administrative unit 
a variety of innovative techniques and materials. The subse- 
quent evaluation of the relative effectiveness of the several 
techniques and materials of instruction employed will be es- 
pecially meaningful. 

The Demonstration Centers in mathematics will incorporate a 
number of innovative features designed to break the cycle of 
failure. Educational innovation is provided through availa- 
bility and use of the newest teaching methods, with programmed 
materials customed to the individual needs of pupils and com- 
bined with close, personal, and individual attention by the 
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teacher. In-service education is designed to develop and 
strengthen attitudes, skills, and understandings of teachers, 
counselors, and other school personnel. Multi-cultural sensi- 
tivity and development of an instructional technology is 
stressed in each Center. 

An instructional media service, located at each Center, will 
provide pupils with materials . appropriate to their needs. 
Teachers are provided with artistic, technical, and clerical 
assistance in the development of materials . Qualified per- 
sonnel coordinate the use of the specialized equipment and 
supplies . 

The target population will be -potentially able junior high 
school pupils (7th grade) who are performing one year or more 
below' grade level: in mathematics. Approximately 250 students 
in each school will be involved in the program. 

OBJECTIVES 

To improve mathematical skills and understandings of 
mathematical concepts. 

To improve the pupil’s self-image. 

To identify specific assets and limitations relating to 
the learning process. 

To develop and use special instructional materials and 
programs and to assess their values. 



To select and use appropriate commercially developed equipment, 
instructional materials and programs and to assess their values. 
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FORM 3 



Description of Mathematics' Project Organization 
Personnel 

1. Each School Center 

a. three teachers 

b. one clerk-typist 

c. one illustrator 

d. one instructional media technician 

2, Central Project Office, serving all Centers 

a. one project coordinator 

b. one curriculum consultant 

c . one counselor consultant 

d. one audio-visual consultant 

e. two clerk-typists 



B. District Administration 

1. Math project is assigned to the district office which 
administers all specially funded programs . 



2. Chart of administrative lines of authority. 




O Assoc. Superintendent 

in charge of instruction 



O Administrator o 
specially fundedr 
proj ects ^ ^ 

(Dr. Gerhard) 





Math project coordinator 
(Mrs, Jones) 



3. The project coordinator is responsible for administration 
of the program and for making all arrangements which are 
required in order to carry out the evaluation. 

C. Teacher Responsibilities 

1. Attend summer workshop prior to teaching classes 

2. Teach two classes per day (total of six classes 
per school) 

3. Create new materials for use in the program 

4 . Responsible to school principal for conduct of classes. 
Responsible to project coordinator for development of 
special math program. 
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D. CSEIP Evaluation Responsibilities 

1. Evaluate program in terms of its stated objectives 

2. Deliver final report to the administrator of specially 
funded projects 

3. Work directly with the project coordinator in carrying 
out the evaluation 

4 . Evaluation team has the option to make intermediate 
reports and to provide information in addition to that 
required in (1) above 
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FORM 4 

' Si z e' o f S c h o ol' Pi's t r i o t 

1. Total number of schools Is 300 , Including 71 
junior high schools 

2. Total number of teachers Is over 12,000 

3. Total number of students Is over 375 , 000 

4. Total geographic area covered Is approximately 
423 square miles 
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FORM 5 



C SEIF Or ganl'za t'i o n 




Project director is a professional researcher. He has no 
formal ties with the school district . 

Advisory Committee is composed of professional educators 
and researchers 

Evaluation team is composed of field researchers, 

statisticians, and research assistants. You are the 
evaluation team. 



II 
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FORM 6 

De's'cr'iptiori of Project Schools 

Math Demo Centers will be established at Alva, East and Valley 
Junior High Schools . 

Communication among the centers may be handicapped by the dis- 

t; 

tance between schools. While Alva and East are only 10 miles 
apart, Valley is more than 20 miles from either one. Frequent 
meetings will therefore be inconvenient for the teachers, and 
communication on such important matters as project goals may be 
limited. 

Sociological conditions are very different at each school, and 

the center teachers may therefore have to face very different 

I 

1 problems. 

East is located in a lower middle-class Mexican-American com- 
munity. The community is extremely stable and most of the stu- 
dents have lived there all of their lives. Many have parents and 
even grandparents who were enrolled in the same school. As 
little English is spoken outside the classroom, language is a 
major problem in the development of material. 



o 

ERLC 



L. \ A 



15 



The population at Alva is highly transient. With a total school 
enrollment of 1600 or 1700, the annual turnover is about 800. 
Many of the students are in and out of the school two, three, 
and even four times a year. Alva is located in what might be 
termed a Negro ghetto. The students come from large families 
and overcrowded houses. A number of parents are on welfare and 
it is not uncommon to find families with a working mother and no 
father. Reading disabilities and the use of nonstandard English 
make language a principal problem at Alva as well as at East. 

Valley is located in a lower middle-class residential area. 

The population of the school is mixed racially with a large pro- 
portion of Caucasians. The transiency rate lies somewhere be- 
tween the stability of East and the instability of Alva. 
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FORM 7 

Information for 'Planning April 

What additional information do you need to know in order to de- 
termine the bounds and opportunities for evaluation in this 
situation? That is, what other information do you need before 
you begin, this summer, to plan the design for this evaluation? 

You now have the opportunity to request information or ask for 
specific action to be taken. All requests for information should 
be submitted on an RFI (Request for Information) form to be 
signed by the team leader. All requests for action to be taken 
are to be submitted on a DAR (District Approval Request) form 
also to be signed by the team leader. 

These forms are to be submitted to your team coordinator and 
only one form may be submitted at a time, 



Your team coordinator will return information to you. 



FORM 8 



R F I 

(Request for Information) 



Request § Team: 



Request for' Tnf oriria'tTon : 



Team Leader 
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FORM 9 



D A R 

(District Approval Request) 



Request # 

f 



Team: 



District Approval Requested for: 



Team Leader 

All questions should be stated in such a form that a yes or 
no answer can be given. 
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FORM 10 -I 

Selection of Experimental and Comparison Groups 

Eligible students were Identified by the Head Counselor at 
each school in cooperation with the Project Counselor. Selection 
was made on the basis of student scores on the California Achieve- 
ment Test (CAT) and the California Test of Mental Maturity (CTMM). 
Potentially able students, those falling in a normal range on the 
CTMM (65-115 ) with achievement scores one or more years below 

grade level formed the pool of eligible pupils. From this popu- 
lation a sufficient number of students was randomly selected 
and assigned to comparison and experimental groups. 

Approved by 
Mrs. Jones 
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FORM 11 -I 



Selection' of Experimental' Teachers 

In selecting teachers for this project, individual schools were 
notified that we were looking for outstanding and creative 
teachers in the field of mathematics. With the encouragement 
of principals, certain teachers throughout the district were 
urged to submit applications. These applications were carefully 
screened by the proper administrators who made the final selec- 
tion, based on the teachers’ outstanding qualifications and 
promise of creativity. 

After teachers had been selected, they were assigned to the 
experimental schools. Only one experimental teacher remained 
in his home school. This occurred at Valley School where the 
principal insisted on having his existing math department chair- 
man as the coordinator of the experimental team in that school. 
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Form 12-1 



Selection of Comparison Teachers 

The selection of comparison teachers was not based on the 
same selection criteria as the experimental teachers. In each 
center, the comparison group teachers were randomly selected 
from the regular mathematics staff. 
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FORM 13-1 

Q'uaTi'fi’ca't Ton's' Tor Experimental Teachers 

1 ) 

2 ) 

3 ) 

4 ) 

5 ) 

> 

I 
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Minimum of three years in mathematics teaching at the 
junior high level 

Master’s degree in mathematics or equivalent 

Mathematics teacher for the past two years prior to 
entering the project 

Willingness to be flexible and creative (principal’s 
j udgment ) 

Three letters of recommendation stating general ability 
to get along well with both students and staff 



FORM 14-1 



Criteria’ 'for' 'Selection of Schools 

Selection of the three schools and of programs for each school 
was done by the district prior to the signing of our contract 
with them. The district assures us that schools were selected 
from "disadvantaged areas" as required by the funding organiza- 
tion. Programs for the schools were determined by district ad- 
ministration. 



Further details are not available. 



FORM 15-1 



' Memo on Testing 

I am sure that we will be able to provide an adequate amount of 
time in order for you to obtain the information required for the 
evaluation, I should think that about three or four days in the 
beginning of the school year and three or four days at the end of 
the school year should be sufficient. Testing will necessarily 
be limited to the students’ mathematics class hour. Our school 
calendar of events is generally scheduled far in advance of the 
opening of school, but I feel reasonably sure that what you re- 
quest can be arranged. We will also be able to provide an 
adequate room and the necessary facilities for the individual 
tests. 

The school district feels that a certain responsibility is owed 
to the parents in our community to insure that children’s time 
is being used for educationau purposes. Moreover, it is our 
direct responsibility to insure the privacy of family life and 
not to unduly intrude into these personal affairs. Please be 
advised that any nonstandard tests must be approved by the 
district office. 

Approved by 

Dr , Gerhard 



FORM 16-1 



Math Test Information 

The school district has on file all major standardized tests of 
mathematical achievement. The file of these is available In 
the school district testing office. We are allowing the evalua- 
tion team complete authority to select the appropriate test for 
use in this evaluation. If the evaluation team decides to pre- 
pare any special measuring instrument, this, of course, would 
be subject to district approval. 

Approved by 

Theodore Wine, Counselor 
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FORM 17-1 
Prior Te s t Pat a 

Results of Intelligence and achievement tests administered 
during the sixth grade are available in each student’s cumula- 
tive record folder and access to these data will be provided by 
the district. 

Approved by 

Theodore Wine, Counselor 



FORM 18-1 



AddTtTonaT School Da t a 



ALVA 



Median IQ - CTMM 
Verbal 85.8 
Non-verbal 89.1 
Total 87.5 



N=355 



VALLEY 



Median IQ - CTMM 
Verbal 98.8 
Non-verbal 99.2 
Total 98.9 

EAST 

Median IQ - CTMM 
Verbal 95.2 
Non-verbal 92.5 
Total 94.0 



N=4?3 



N=421 



Tests Taken by Individual Pupils 

1. IQ test results 

a. Blnet 

b. WISC 

c . Kuhlmann-Anderson 

d. Detroit 

e. Public School Primary 

2 . Achievement Test 

3. Ten Week Math Grade and Citizenship Report 
(last ten weeks of the school year) 
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ALVA 



Median IQ - Arithmetic 
Reasoning 18.5 

Fundamentals 29.7 



VALLEY 

Median IQ - Arithmetic 
Reasoning 28.3 

Fundamentals 40.3 



EAST 

Median IQ - Arithmetic 
Reasoning 20.0 

Fundamentals 34.8 



Number of Feeder Schools 
ALVA 9 

EAST 6 

VALLEY 9 

Mean Achievement Scores 



Median IQ - CTMM of Feeder Schools 

v 90.3 nv 90.7 

v 92 . 2 nv 84 . 4 

v 96.8 nv 97.5 



By Stanines: 


EAST 


VALLEY 


ALVA 


7.0 - 9.0 


2.0 % 


11 . 6 % 


7.0 


5.0 - 6.9 


2k .2 


39.7 


32.6 


3.0 - 4.9 


35.5 


35.9 


46.5 


1.0 - 2.9 


38.3 


12.8 


13.9 
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Educ at 1 ona 1 As p i rat i ons of Schools 



' J I wish to: 

f 

j: Quit school 

Finish high school 
Go to school after high 

I school 
Don’t know 

J 

i! 

h 

ji 

II 

| Recorded Grades in Math 

Lafet year’s grades 

A 

B 

C 

D 



EAST 


VALLEY 


ALVA 


2.0% 


6.1)% 


9.3# 


32.3 


21.8 


30.2 


57.4 


69.2 


55.8 


8.3 


2.6 


4.7 



EAST 


VALLEY 


ALVA 


8.4% 


13.7% 


5.6$ 


19.0 


22.7 


18.8 


^5.3 


37.4 


39.7 


27.3 


21.6 


30.0 


3.6 


4.6 


5.7 
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FORM 19-1 



CuMuTa'friVe' Folder Information on Pupils 



The following type of Information is available on each pupil * s 

cumulative card. 

name 

age 

sex 

schools attended 
number of brothers and sisters 
birthplace of parents 
languages spoken 

special achievement (based on group and achievement tests) 
educational achievement 

pupil's interests (based on inventory and aptitude tests) 
family and home relationships 
activities of the child in and out of school 
educational and vocational plans 

types of agencies the child-might have had contact with, 
such as, law enforcement, accelerated programs, etc. 
semester grades 
attendance record 

The accuracy and completeness of these cards is solely dependent 
upon the school” counsel or . ° Therefore , ’sbme of this Iftformatibh 
might be missing. 



' Tests on File 



Stanford 

Lorge-Thorndike 

MMPI 



CAT 

CTMM 

Iowa 



wise 

Kuh lmann- Ande r s on 
Detroit 

Public School Primary 



Approved by 



Theodore Wine, Counselor 
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FORM 20-1 

Information on Pupil Self-Concept 
Summary of Data on Experimental Classes 



I FEEL THAT 


I AM AT LEAST 


AS GOOD 


AS OTHERS I KNOW* 




' East 


Alva 


Valley 


Strongly Agree 


18# 


33 % 


16 % 


Agree 


56 


48 


66 


Disagree 


23 


16 


15 


Strongly Disagree 


3 


3 


3 


Total 


100# 


100# 


100# 




(210) 


(170) 


(258) 





IN 


GENERAL,.. 


PEOPLE CAN BE 


TRUSTED# 














East 


Alva 


Valley 


Strongly 


Agree 


11# 


15# 


7# 


Agree 




44 


34 


56 


Disagree 




38 


38 


33 


Strongly 


Agree 


7 


13 


4 




Total 


100# 


100# 


100# 






(210) 


(169) 


(257) 
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PEOPLE SHOULD NOT 


EXPECT TOO MUCH OUT OP 
BE DISAPPOINTED. 


LIFE SO THEY WON’T 




East 


Alva 


Valley 


Strongly Agree 


30% 


36$ 


20$ 


Agree 


56 


44 


52 


Disagree 


11 


17 


22 


Strongly Disagree 


3 


3 


6 


Total 


1005S 


100$ 


100$ 




( 209 ) 


(168) 


(257) 


• 


ip i could, I'd: 


RATHER BE 


SOMEONE 1 ,. DIFFERENT PROM MYSELF. 




East 


Alva 


Valley 


Strongly Agree 


17 % 


1% 


11$ 


Agree 


27 


22 


16 


Disagree 


35 


34 


4l 


Strongly Disagree 


21. 


■ 37 


32 


Total 


100$ 


100 % 


100$ 




(208) 


( 169 ) 


(257) 










* * r 

THERE ARE . TIMES . WHEN I 


THINK I AM 


NO GOOD AT ALL. 




East 


Alva 


Valley 


Strongly Agree 


22$ 


12$ 


17* 


Agree 


56 


52 


59 


Disagree 


17 


22 


16 


Strongly Disagree 


5 


14 


8 


Total 


100$ 


100$ 


100$ 




(209) 


(169) 


(258) 
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ON THE WHOLE, I'M PRETTY WELL SATISFIED WITH MYSELF. 





East 


Alva 


Valley 


Strongly Agree 


20# 


33# 


14# 


Agree 


58 


58 


68 


Disagree 


19 


8 


15 


Strongly Disagree 


3 


1 


3 


Total 


100# 

(209) 


100# 
• ( 169 ) 


100# 

(256) 



THERE ISN'T MUCH PEOPLE CAN DO ABOUT THE WAY THINGS ARE 

GOING TO TURN OUT IN LIFE. 





East 


Alva 


Valley 


Strongly Agree 


16# 


26# 


12# 


Agree 


40 


42 


42 


Disagree 


29 


18 


32 


Strongly Disagree 


15 


14 


14 


Total 


100# 

(210) 


100# 

.(168) 


100# 

(257) 
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FORM 21-1 

' G'liifl'artc'e' and' Counseling; 

The counseling consultant assigned to the Project will aid the 
principal and school counselor in the selection of pupils for 
the program. He will also assess the special needs of the 
pupils enrolled in the experimental classes. Through the use 
of standardized tests, prior grades, and consultation, the 
project counselor will work with the project teachers in deter- 
mining the learning needs of individual pupils . 
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FORM 22-1 



District' A'nt'ie'i'p'a't'i'ori of 'Evaluation Function 



Evaluation will be guided by the general and specific objectives 
of the project. It will assist in orientation of the project 
staff to its purposes and needs by reporting on a regular basis 
to those individuals in a position to best act on such reports. 

In addition* the district expects the evaluation team to submit 
a final report at the conclusion of the school year. This report 
along with recommendations from the project staff will be used in 
helping the district decide whether or not to continue this pro- 
ject . 



Approved by 



Dr. Gerhard 
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FORM 23-1 



Gerhard , Calvin 
Age 55 
Education 

1) B. A. Wabash State - 1933 

2) M. A. Wabash State - 1938 

3) Ed. D. Wabash State - I960 

Experience 

1 ) 1933 - 1938 - Social Studies Teacher, Jonesville, Indiana 
1938 - 1942 - Vice Principal, Smithtown, Indiana 

1942 - 1944 - Principal, Smithtown, Indiana 

2 ) 1944 - 1946 - U. S. Army 

3) 1946 - I960 - Director Experimental Elementary School 

Programs, Smithtown, Indiana 

4) I960 - 1965 - Coordinator of Secondary School Project, 

City District, California 



5 ) 



1965 - Present- Administrator of Specially Funded Projects, 

City District, California 
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' Objectives' for Summer Workshop 



1. Provide teachers with information about 

a. The cultural background of students in the experimental 
program, 

b. Typical school behavior of these students. 

2. Increase teachers’ understanding of the relation between 
reading ability and achievement in mathematics. 

3. Increase teachers’ ability to use discovery methods in 
teaching mathematics. • 

4. Provide opportunities for teachers to become familiar with 
a wide range of commercially available materials for use 
in the teaching of mathematics. 

5. Provide opportunities for teachers to begin work on the 
development of new materials for use in the experimental 
classes. 

6. Increase teachers’ understanding of themselves and of 
one another through sensitivity training sessions. 
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Program and Objectives 

Programmed Learning: Alva' Junior High 

The objectives of this Center are the selection, study, and use 
of commercially developed programmed materials and the develop- 
ment of programmed materials which will be successful with dis- 
advantaged students. 

Programmed materials designed for use in automated equipment 
will receive attention. The quantity of such materials developed 
in the last 5 or 6 years will require a refined selection cri- 
teria. The teachers will, therefore, screen existing materials 
and select the most appropriate. For the area in which existing 
materials are scarce, the teachers will develop and refine pro- 
grams. They will also determine which topics are best taught 
through programmed materials exclusively and which are best 
taught through programmed materials in conjunction with other 
media. 
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Closed ’Circuit Television Retrieval Center: 

Valley Junior High 

‘The primary objective of this Center is to individualize in- 
struction to accomodate the wide disparity of abilities among 
individuals. It will seek answers to such questions as "In 
what ways can materials be provided at the learning level of 
each individual?" 

The Center will measure changes in student and teacher behavior 
due to the use of a retrieval system., and train teachers to 
^effectively utilize such systems. It will produce appropriate 
lessons on video-tape not available commercially. 

The Center will provide individual students, groups, and classes 
the opportunity to view and listen to instruction on film, 
tapes, and slides. It will provide students with programs at 
the best time suited to their learning needs. The system will 
bring to the students educational materials not usually avail- 
able through the school r s own resources. The project will pro- 
vide a prototype video-audio distribution system which will 
utilize a variety of new media in various learning situations. 




Mathematics’ Laboratory: East Junior High 



The literature attests to the lack of manipulative and sensory 
experiences of disadvantaged children. The result is a scarcity 
of quantitive concepts. The mathematics laboratory will provide 
compensatory experimental background to meet these needs. 

The main objective of this Center is the development of 
materials and methodology appropriate for use in a multi-media, 
multi-sensory environment. This environment will contain 
materials for the construction of objects by pupils, math tools 
and equipment, books, units, guides, programs, mathematically 
oriented games, and instructional equipment such as recorders 
and projectors. 

This approach will encourage the discovery of key mathematical 
principles through raising problems, asking questions, and using 
a variety of tools and instruments for use in counting and 
measuring physical objects. This will facilitate the transla- 
tion of the concrete to the abstract . 
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District' Budget 

Equipment and materials per Center: 



Alva 


$90,000 


East 


90,000 


Valley 


' ' 96,000 
' $276,000 


Administrative Salaries 


' ' 84,000 


Total 


$360,000 



Approved by 
Dr , Gerhard 
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Evaluat ion Bu'd'ee t 



Salaries 


$4o,ooo 


Consultants 


10,000 


Test administration 


6,000 


Development of additional 

tests 


3,000 


Data processing 


6,000 


Rental of office space 
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District' 'A'p'p'r'ova 1 



Response to request '#■' ' 



Team':' ' 



We are pleased to approve your request. We will be happy to 
cooperate . 

Approved by 

Mrs, Jones 

Project Coordinator 
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D istrict' Denial 



Response to request # Team: 



Your request is contrary to district policy on this matter, 
and must be denied. 

Approved by 

Mrs. Jones 

Project Coordinator 
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Response to request '§ Team: 

We regret that we do not have the information you requested. 
It is not likely that we would be able to obtain it in time 
for you to make use of it , 

Approved by 

Mrs. Jones 

Project Coordinator 
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Response to request ft Team: ___ 

The district feels that decisions of this type are a normal 
operational part of the evaluation function; it is assumed that 
your evaluation team will make the appropriate decision. 

Approved by 

Mrs. Jones 

Project Coordinator 
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Response to request # Team:___ 

It is our impression that this information was provided in a 
prior report to you. If you are unable to locate it please 
let us know. Re-compiling the information will require some 

time . 

Approved by 

Mrs. Jones 

Project Coordinator 
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Response to request # 



Team: 



It appears that we have misplaced your file. We shall continue 
to look for it. If you restate the request we shall give it our 

immediate attention. 



Approved by 

Mrs. Jones 

Project Coordinator 
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Response to request # Team: 

At this moment we regret to inform you that the information is 
not available, however, we also recognize the importance of 
having this information. Consequently, we are in the process of 
compiling the materials that you have requested. Please resubmit 
your request. 



Approved by 
Mrs. Jones 



Project Coordinator 
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Response to request § Team:__ 

The teachers are now in the process of trying to reformulate 
these ideas. There seems to be no agreement at the moment, but 
we are confident that a satisfactory solution will be arrived at 
soon. Please submit your request again. 

( 

< 

Approved by 

Mrs. Jones 

Project Coordinator 





FORM 36-DJ 



Response to request # Team: 

Because of our obligation to the community, district policy will 
not permit delegation of responsibility in this matter. If you 
will restate your request, we shall inform you of our decision 
as soon as possible. 



Approved by 

Mrs. Jones 

Project Coordinator 
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Response to request # Team: . — 

We have been working on this problem since we received your 
original request. Unfortunately , we have not yet finished, but 
hope to soon. 

Approved by 

Mrs. Jones 

Project Coordinator 
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Response to request # Team: 

We regret delaying you again. We are still working on the problem, 
but I must admit we have had considerable difficulties. We haven’t 
given up, however. 



Approved by 

Mrs. Jones 

Project Coordinator 
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Response to request § 



Team: 



District policy is unclear in this matter. We have referred the 
question to Dr. Gerhard’s office. 



Approved by 

Mrs. Jones 

Project Coordinator 
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Response to request it Team: — — __ — — — 

Dr. Gerhard is out of town at present. Can we call you when he 
returns? Please submit your request again if you wish to meet 

with Dr. Gerhard. 

Miss Hawkins 

i 

Secretary to Dr. Gerhard 
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Response to request # Team:^ __ 

Through an oversight, the Administrator of Specially Funded 
Projects has two appointments scheduledfor this hour and cannot 
meet-, with you. Would you care to make another appointment at a 
later date? Please submit your request again if you wish to 
meet with Dr. Gerhard. 



Miss Hawkins 

Secretary to Dr. Gerhard 
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FORM 42-DG 

Response to request § Team: .. 

Summary of meeting with Dr. Gerhard 

Our district personnel are deeply appreciative of your efforts and 
recognize your desire for the information requested. However a it 
is the opinion of our administrative staff that your request cannot 
be approved since district policy appears to be in direct conflict. 
We regret the delay in responding; several officials had to be 
consulted for a decision. 




4 



5 ? 



FORM 43-DG 



Response to request #___ Team:^ 

Summary of meeting with Dr. Gerhard 

We are sorry to inform you that we do not have this information 
on file* We will be happy to cooperate, however, in making it 
possible for you to gather the information yourselves. 
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Response to request Team: 

S ummary of meeting with Dr. Gerhard 

After consultation with several district administrative officers, 

I am happy to tell you that we have approved your request. Please 
j let me know whenever I can be of service to you. 
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Response to request § 



Team: 



Dr. Gerhard nas asked that I forward the attached information to 



you. 



Mrs. Jones 
Project Coordinator 
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Preliminary Design 

As a result of your questions, you have now obtained a number 

of clarifications of the program, 

1. What information do you now propose to collect, from whom, 
about what, at what times, and by what means in order to 
have what you will need to prepare an evaluation of this 
program? 

2. Indicate 'the steps you plan to take now to assure yourself 
that you will get the kind of information you need. 

Write these statements and give them to the team coordinator. 

At this time yoq may wish to submit additional RFI or DAR forms. 

You may submit no more than three of these forms. 

Your statement will represent your preliminary design report to 

the CSEJP Evaluation Project Director. 
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PRELIMINARY DESIGN REPORT 
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Characteristics of East Center Teachers 
TO : CSEIP STAFF 

FROM; Staff Interviewers 

SUBJECT: Summary of Interview with East School Principal 

(You may assume that the differences among the East Center 
teachers are typical of differences found in the other two 
Centers . ) 

This is a summary of an interview with the principal at East 
School. The teachers at this Center were characterized in the follow- 
ing ways; 

1. Name; Mr, James Wilcox 

Mr. Wilcox is a successful teacher of long standing in the dis- 
trict. He is creative, able to explore new materials, and imagina- 
tive in the activities he selects for his pupils. He tends to in- 
volve the students in much decision-making and allows them to move 
out of their seats quite a bit. He has a reputation in the district 
for having a somewhat noisy, active, unruly classroom. He has been 
informed frequently of the need to maintain a more uncluttered, well- 
organized room environment. He is bright, eager to learn and most- 
anxious to please. He is ready to accept nearly all suggestions and 
profit by them. 

2 . Name : Mr. Gerald Forbes 

Mr. Forbes is a well-mannered, orderly individual who is able to 
maintain a quiet room. He is always careful to see that each student 
Knows the fundamentals of mathematics before moving on to complex 
material. He enjoys his students and interacts warmly with them. 

At the same time that he covers the material, he is a strong leader 
among his students with solid convictions about the need for good 
discipline and firm control. He has a good reputation with his 
district superiors and is seen as efficient and competent in 
carrying out any task he undertakes. 

3 . Name : Mr. Henry Webster 

Mr. Webster is unusually bright and imaginative in his selection 
of materials and methods. He has been doing demonstrations in the 
district for many years and is enthusiastic about new ideas. He 
has published sets of materials for use by other teachers and has 
led a number of workshops and inservice classes in mathematics. 

His peers respect and like him, and he is often characterized as 
their spokesmen. He does tend to think for himself and make deci- 
sions without consulting others. He has also been warned of 
spreading himself too thin in that he is consistently involved with 
educational courses and conferences which take him off the premises. 
In spite of this, however, Mr. Webster does produce considerably. 
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Field Report Summary Sheet No. 1 - November 



The program has now been in progress for several months. You 
have had observers in the classrooms of the three schools. Follow- 
ing is a summary of some of their observations: 
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VALLEY 

1. To date no television equipment has arrived. Delivery date is 
uncertain. 

2. The first clerk left the job and has not been replaced yet. 

This makes it difficult to produce teaching materials. 

3. Pupils in comparison classes seem to be more capable in mathe- 
matics than the experimental classes (Better check selection 

process ) . 

4 U A personality conflict has caused a split in Center personnel — 
team meetings of teachers have been discontinued. 

5. Morale of teachers is becoming shaky. 



EAST ' 

1. Math lab approach is working smoothly. 

2. Pupils come in at lunch hour and after school to work in the 
math lab . 

3» Factory equipment for math lab was late 2 arriving. Teacners 
made their own equipment. 

4 . Classrooms too close together — noise level is extremely high. 

5. First four weeks of materials seem original and creative, but 
these materials have not been put in finished form. 

6. The teachers work on materials as a team. Group spirit is 

high but so is group disappointment with project administration. 

7. One teacher is talking of transfering out of the project at 
mid-year . 
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ALVA 



X. Fuplls seem to have great difficulty with the procedures used 
in programmed instruction. 

2. Clkss size averages five to six pupils below original plan of 
20 pupils per class. 

3. While waiting for much of the equipment for programmed instruc- 
tion to arrive, the teachers are using several commercial text- 
books . 

4. The school administration requires teachers to assume many 
supervisory tasks, which interferes with the time they have 
to design and create new materials. 

5* Teachers test materials they have created in each others’ 
classrooms — they work together on working out the ’’bugs . ” 

6. The classrooms experience constant interruptions from announce- 
ments on the school public address system. 



General Comments 

«■ " ■ > ■■ ■— " » — - , r— 

1. The illustrators and the math consultant are spending more time 
in the Central Office on ’’other duties” than in the three 
Centers. As a result no new materials which teachers have - 
created have been put in finished form. No procedure has yet 
been se t up to field test new materials within the three Centers 
or in other schools. 

2, The project counselor has been promoted and is no longer with 
the project. His position has not been filled yet. 

3, The project has suffered a cut in the budget, eliminating the 
audio-visual consultant and one instructional media technician. 
The three centers will share the remaining two technicians. 

4. Observations indicate that in general the project teachers are 
really trying to individualize instruction. Experimental classes 
appear to be much more flexibly organized than the comparison 
classes . 



ERIC, 



VO 



FORM 49 



District Request for Information — December 

Mrs. Jones has relayed a request from Dr. Gerhard regarding 
some interest that has arisen among District personnel » 

The specific questions are: 

X. The teachers have indicated an interest in "how they are 
doing" with respect to the math program? 

2. With respect to the materials that have been developed, 
which seem to be most effective in the math program? 
Please address your responses to Dr. Gerhard and file them 
with the simulation coordinator. 
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INTERMEDIATE REPORT TO DISTRICT 



Team 



Date 
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Progress Report to CSEIP Evaluation Project Director 

— December 

You have now had some introduction to initial aspects of the 
math program in the field stage. 

What is your current thinking with regard to the evaluation 
project thus far? Please write up any impressions which you 
want to report to the CSEIP pi’oject director. 

Your comments may simply consist of a brief listing or 
enumeration of your observations to date. When finished, 
submit them to the coordinator. 



FORM 50a 



PROGRESS REPORT TO CSEIP 



Team 



Date 



i 
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January 



To Team: 

From : Dr. Gerhard 

Re : Your report of December 

Mrs. Jones has relayed to me your report concerning teachers 
and materials in this project. Let me thank you for your 
efforts thus far. 

Further reports have come to me indicating that my principals 
are pleased with the program. We shall all continue to 
cooperate in every way to make this project successful. 
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January 



To Team: . ( each team) 

From : Director; Evaluation Project — CSEIP 

Re : Your report of December 



We received your field report with much interest. I reviewed 
your original preliminary design report and hope you will con- 
tinue to keep me posted on progress. 
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Field Report Summary Sheet No. 2 - February 



1. The Project has lost two teachers. John Snow at Alva has 
: been promoted to Vice-Principal and has been assigned to another 

I school. Henry Webster at East, due to a dispute with Central 
Office, decided to leave the project. These teachers will be 
j replaced immediately. 

2. In the middle of the first semester, Bill Sinclair at 
Valley was transferred to the Central Office. For the second 
semester, he will be sent back to Valley, while Howard Smith from 
Valley will be sent to the Central Office to work on materials 
created in all 3 centers. This means that there are only two 
teachers at Valley. They will cover all the classes originally 
assigned to three teachers. This leaves them less time to work 
on new materials. 

3. Another problem is the rapid pupil turnover at Alva. The 

! Project there has lost Oxie-third of its students. Of the original 
250 pupils, we estimate that about 80-100 will still be there in 
June. 

4. One television camera has been delivered to the Valley 
School Center, The rest of the equipment is not expected until 

' May . 



5. Observations continue to indicate that most experimental 
teachers use a variety of teaching materials and techniques and 
have established good working relationships with most pupils. 
Experimental classes still appear to be more flexibly organized 
than comparison classes. 

6. A new counselor has been assigned to the project. 

7. Two units of new materials from Alva have been finished 
and will be tested in a few other schools. 
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Design Review Task 

In view of the field research reports which have 
been presented to y°u, what are your feelings as to 
what you can now do with the data you plan to collect in 
the design previously submitted? Do these effects destroy 
the evaluation* alter its characteristics, or what? What 
kinds of things do you now think that you will be able to 
tell the districts now or at the conclusion of the evalua- 
tion? Please file a report with your coordinator. 
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DESIGN REVIEW REPORT 




Summaries of 



Audio-Visual Materials 



FOR USE BY 

SIMULATION STAFF ONLY 
NOT FOR DISTRIBUTION 
TO PARTICIPANTS 
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Summary of Taped Interview with Dr, Gerhard AY-1 

1) 8 % minutes long 

2) Gerhard in a very wordy manner demonstrates his willingness 
to ’’cooperate in any way possible” with the program 

3) Discusses the importance of an evaluation 

4) Sets certain conditions on data collection 



a. 

b. 



c . 



Instruments to be approved before being used 
No personal questionnaires about the children’s 
families 

No women data collectors in the schools with short 



skirts; no beards on the men data collectors 

5) Concludes by again expressing his willingness to cooperate 
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AY- 2 



Summary of Slides 

' ■■ | i i 1 1 1 1 I —T 

1) Classrooms and playgrounds at the three schools are shown 
(Alva, East, Valley). 

2) The three communities surrounding schools are shown, 

3) Alva is mostly Negro, located in what might be called a ghetto. 

4) East is mostly Mexican-American, located in a heavily Mexican- 
American area. 

5) Valley is mostly white, located in the suburbs. 




Summary of Taped' First' TntervieW With' Mrs'.' 'Jones AV-3 

1) minutes long 

2) Mrs. Jones expresses her interest in the program 

3) Describes changes in the administrative structure 

4) Mrs. Jones reveals that she could perhaps be a very 
difficult person to deal with 

5) Mention is made of problems with equipment and materials 

6) Teachers are supposed to turn in weekly reports to Mrs, 

Jones 

7) First indication that there is no clear access to decision- 
making personnel 

8) Concludes with Mrs. Jones expressing the desire to cooperate 
with the program 
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Summary of Second Tap'e'd Tn't'erview with Mrs , Jones A V - 4 

1) 13g minutes long 

2) Second mention of the fact that problems are arising 
with materials and equipment 

3) Indication that teachers in individual centers are 
going to use commercial materials instead of developing 
their own 

4) Mrs. Jones criticizes teachers for not turning their 
weekly reports in on time 
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Summary of Film' of Teachers at' East' School Center AV-5 

Seven minutes long 

The film shows each teacher with one of his classes 

The first teacher (James Wilcox) is having his pupils work 
with a small computer. There is much informal interaction 
between teacher and pupils and 'much movement around the room. 

The second teacher (Gerald Forbes) has pupils working while 
seated at their desks. The only movement is when one pupil at 
time comes up to the board. 

The third teacher has several activities going on at once. 
Some pupils are using geometrical blocks to work out puzzles, 
teacher plays dominoes with another group. 
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Summary of Third Taped 'Interview with’ Mrs . Jones A V-6 

1) 5 minutes long 

2) Mrs. Jones reveals that teachers were developing 
materials all along but she just wasn’t sending the 
CSEIP staff copies of them. She gives some vague 
excuse for this. 

3) Pinal indication that Mrs. Jones is one of the prime 
reasons that communications and decision-making are 
difficult within the district system. 
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Summary of Taped Tnt'ervTew with - Mr. Wine, Counselor 

1 1 ' i ■ ■■ 1 ■ f ■ - ■ — *»*— ■ 1 *■ ■ ■ 

1) bh minutes long 

2) Mr. Wine reports that at Alva School there has been a 25% loss 
in pupils in the program. 

3) The method of replacing the pupil loss is indicated. This is 
not done strictly according to an experimental design. 

4) Classes at Alva are not . left intact. Children have been 
shifted from one teacher to another, and some of the original 
experimental groups have been consolidated. 

5) There has been loss of experimental teachers from, all of the 
schools . 

6) Ea^st school has had little change. 

7) Sex ratio in classes at Valley gets altered because some of 
the teachers prefer classes of all boys or all girls. 

8) There is a 40$ loss in pupils in the comparison classes at 
Valley . 

9) Traveling teachers have been set up to aid the central staff. 
One of these teachers came from Valley. His position was 
not filled. Instead the other experimental teachers there 
were required to teach extra classes. 
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Summary of Taped Interview With' Teacher AV-8 

1) 8 minutes long 

2) Teacher expresses concern over lack of communication with 
Mrs. Jones. 

3) Mention is made of problems in acquiring needed equipment 
and consultant help. 

4) Teacher reveals she has allowed other teacher to borrow 
materials for use in other classes. 

5) She has also allowed other students to use the materials 
which were prepared for her own class. 

6) Teacher complains of having especially heavy workload so 
that little time is left to produce needed materials. 

7) She:; mentions that in-service training was inappropriate in 

preparing her to do the job. ; " 

* < 

8) She reminds listener that one teacher was transferred out of 

the program and concludes that this is not surprising in light 

of inability to solve the many problems faced by teachers in 
the program. 




